BioNLP'09 Shared Task on
Event Extraction
in conjunction with BioNLP, a NAACL-HLT 2009 workshop, June 4-5 2009, Boulder, Colorado
[Shared Task Home] [Evaluation Methods] [Master Result Table] [Team Profiles] [System Profiles]

Final Evaluation Results
on Localization events by Approx. Span matching

Task 1

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[ UTurku  ]        Localization          174 (   86)      105 (   86)    49.43    81.90    61.65
[VIBGhent ]        Localization          174 (   76)       97 (   76)    43.68    78.35    56.09
[JULIELab ]        Localization          174 (   76)       98 (   76)    43.68    77.55    55.88
[UT+DBCLS ]        Localization          174 (   66)       75 (   66)    37.93    88.00    53.01
[ConcordU ]        Localization          174 (   62)       67 (   62)    35.63    92.54    51.45
[ UNIMAN  ]        Localization          174 (   78)      147 (   78)    44.83    53.06    48.60
[ UTokyo  ]        Localization          174 (   55)       58 (   55)    31.61    94.83    47.41
[ UAveiro ]        Localization          174 (   62)       88 (   62)    35.63    70.45    47.33
[ASU+HU+BU]        Localization          174 (   57)       70 (   57)    32.76    81.43    46.72
[CNBMadrid]        Localization          174 (   61)      114 (   61)    35.06    53.51    42.36
[  UMich  ]        Localization          174 (   80)      212 (   80)    45.98    37.74    41.45
[  SCAI   ]        Localization          174 (   48)       58 (   48)    27.59    82.76    41.38
[   Cam   ]        Localization          174 (   45)       50 (   45)    25.86    90.00    40.18
[ Team 24 ]        Localization          174 (   48)       80 (   48)    27.59    60.00    37.80
[  UNSW   ]        Localization          174 (   40)       41 (   40)    22.99    97.56    37.21
[  NICTA  ]        Localization          174 (   42)       66 (   42)    24.14    63.64    35.00
[UAntwerp ]        Localization          174 (   36)       46 (   36)    20.69    78.26    32.73
[ KoreaU  ]        Localization          174 (   35)       43 (   35)    20.11    81.40    32.26
[CIPS-ASU ]        Localization          174 (   49)      143 (   49)    28.16    34.27    30.91
[ UZurich ]        Localization          174 (   32)       34 (   32)    18.39    94.12    30.77
[  PIKB   ]        Localization          174 (   19)       23 (   19)    10.92    82.61    19.29
[CCP-BTMG ]        Localization          174 (   18)       18 (   18)    10.34   100.00    18.75
[ USzeged ]        Localization          174 (   14)       33 (   14)     8.05    42.42    13.53
[ Team 09 ]        Localization          174 (    1)        1 (    1)     0.57   100.00     1.14

Task 2

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ]        Localization          174 (   57)       75 (   57)    32.76    76.00    45.78
[ASU+HU+BU]        Localization          174 (   42)       70 (   42)    24.14    60.00    34.43
[CNBMadrid]        Localization          174 (   49)      114 (   49)    28.16    42.98    34.03
[ Team 24 ]        Localization          174 (   39)       95 (   39)    22.41    41.05    29.00
[UAntwerp ]        Localization          174 (   31)       46 (   31)    17.82    67.39    28.18
[CCP-BTMG ]        Localization          174 (   17)       18 (   17)     9.77    94.44    17.71

Task 3

------------------------------------------------------------------------------------------------
   TEAM                                 gold (match)   answer (match)   recall    prec.   fscore
------------------------------------------------------------------------------------------------